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Now I am profoundly convinced that it is in the last 
degree unscientific — yes, absurd — to accept at its 
face value testimony about a method by the man or 
the woman who invents it or advocates it with special 
emphasis. To get right results, there should be, in 
every case, an examination of the working of the method 
by some one else, not in any sense committed to it, 
and preferably by some one not interested in it, or 
even by one hostile to it. And, lastly, it should be 
remembered that the real truth will not reside with 
either of the two persons referred to above. What 
these two say should be 'evaluated' by a third person. 
In this way we should be getting some approximation 
to the truth. 

Does any one know of a single instance in which, in 
an educational matter, any such procedure has been 
followed ? 

C. K. 



MR. BROWN'S "LATIN IN SECONDARY 
SCHOOLS" 1 

Two considerations led me to promise to present this 
subject here. In the first place, I am convinced that 
the teachers of Latin, if they are to have a part in the 
determination of our future educational policy, must 
become acquainted with the nature and the methods 
of the new pedagogy, in which the attempt to establish 
an exact science is based, in part, upon the large use of 
mathematics. Secondly, and more particularly, Mr. 
Brown's findings are being generally accepted as final, 
and are influencing the attitude of School officials to 
such an extent that it is the duty of teachers of Latin 
to know what these findings are, and how far they are 
sustained. 

The body of Mr. Brown's book runs to 144 pages, 
and there are 26 pages more of statistical appendices. 
The text itself contains 80 statistical tables. The 
investigation was made in 1916 and 1917 as an activity 
of the Bureau of Educational Research connected with 
the New Hampshire Department of Public Instruction, 
but was financed by the General Education Board. 
The various tests which furnished the facts weighed 
in the investigation were taken by from 813 to 2,160 
pupils, in from 15 to 34 Schools. 

Mr. Brown believes that he has shown, not only 
that Latin is not taught with a reasonable degree of 
success, but also the reasons for failure, and the reme- 
dies. On this road he leaves his facts so far behind 
as to rouse the suspicion that the study was under- 
taken in the conviction that it would support certain 
theories to which the New Hampshire Department of 
Public Instruction was committed. Whatever may 
be thought of the tests themselves, however much the 
results are discounted, the showing is not favorable to 
the study of Latin. Yet even in this regard Mr. 
Brown's attitude is unscientific. He plainly wishes 

>A Study of Ability in Latin in Secondary Schools, etc. See the 
third entry under Mr. Brown's name above, page 153. The paper 
printed here was read before the Connecticut Section of The 
Classical Association of New England, at Watertown, October 
29, 1921. 



it to be understood that the deficiency is peculiar to 
Latin, and obtains for the whole country; but there is 
no evidence that other subjects are taught more 
effectively in New Hampshire, and no conclusive 
evidence that the teaching of Latin in New Hampshire 
is typical. 

In appraising the value of such a study as this, it 
is necessary, I take it, to consider at least these four 
points: (1) Were the tests used adapted to their 
purpose?; (2) Was sufficient time allowed?; (3) Was 
the method followed in evaluating the tests sound, 
and was it so employed as to reveal the essential facts 
in their exact relations?; (4) finally, Are the induc- 
tions of the investigator valid? The question of the 
correctness of the scales used by Mr. Brown in scoring 
the tests I must leave to those who are more familiar 
than I with the subject of statistical measurement of 
educational results. Nor have I attempted to verify 
the mathematical operations involved. 

There remain three of the points that I have men- 
tioned as deserving consideration in an appraisal of 
such a study as the one before us. It is my intention 
to examine the first two of these now with reference 
to individual tests, but some general criticism belongs 
here. In the first place, I do not recognize the need of 
certain of the tests, though they are of an accepted 
kind, nor place much weight upon the results they give. 
Syntax and vocabulary are taught naturally and 
effectively only as the knowledge functions in reading, 
writing, or speaking. Functional knowledge in these 
fields, if not the only profitable knowledge, at any rate 
is alone worth testing in such an investigation as 
that of Mr. Brown; and translation from Latin or 
into Latin affords an accurate test, if the material is 
wisely chosen. Moreover, the setting of short sen- 
tences for translation into English is an awkward 
way of ascertaining whether advanced pupils can read 
a language intelligently, and should not be resorted to 
where pupils have begun to read connected narrative. 
The tests we are considering go further astray even 
than this. The test in grammar and that in vocabu- 
lary, as well as both the tests in the translation of 
disconnected sentences, were the same for pupils in all 
four years of the course, and the same passage from 
Caesar was put before pupils in the last three years of 
the course as the sole test of their ability to read. 
The object was to obtain a comparison of attainment 
in different years, a measure of increase in power; 
but this object was not accomplished with the sureness 
that would carry conviction. In so far as the tests 
are satisfactory for the lowest class, they are inadequate 
to determine, in any large way, the progress higher 
classes have made. This is not to deny the importance 
of mastery of the elements of a study, but only to 
maintain that the whole extent of a pupil's knowledge 
of a language or the total increment of power from its 
study cannot be fully measured in terms of ready 
manipulation of elementary material. 

I pass now to specific faults in individual tests. 

Too little time was allowed for the Latin Sentence 
Tests. I am perfectly aware that it is part of the 
theory of such measurements as these that promptness 
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is to be taken into the reckoning; but it is assumed 
that the material is such that the pupil can deal with 
it promptly, either giving the correct answer or recog- 
nizing his inability to give it. If, however, the ma- 
terial is linguistic, if that which is known to the pupil 
is inextricably involved with that which is not known, 
and if the problem, then, demands of him repeated and 
various applications of his knowledge of forms, syntax, 
and vocabulary to discover some bearing upon the 
unknown factors, surely the results of the test will be 
vitiated by a limit of time which supposes an instan- 
taneous response to the questions. It took me ten 
minutes to write clearly the translation of Test B, 
for which pupils were allowed only thirty. 

The sentences contain a number of rare words. 
For example, according to Professor Lodges' Vocabu- 
lary of High School Latin, aeger, anima, idcirco are 
not found in the Caesar usually read in the Schools; 
redigo is not in the Cicero or Vergil usually read ; nuper 
occurs but once in the Caesar, and tempto only three 
times; recuse is found twice in the Caesar and once in 
the Cicero, aeger and anima only once in the Cicero, 
quoad five times in all the reading of the course, and 
idcirco three times. No single book for beginners has 
just this vocabulary. At the same time many of the 
sentences, if not all, were taken from books in use in 
the Schools, and must have been, therefore, for some 
puoils tests of memory rather than of command of 
the language. What is worse from the point of view of 
uniform measurement, different sets of pupils were 
familiar with different sentences. 

There are in the sentences a rather large number of 
constructions that are either not found in all elementary 
books or are passed over lightly by teachers who center 
attention upon the commonest usages of Caesar; in 
accordance with the scheme of Byrne's Syntax of 
High School Latin, or similar plans. I note dative, of 
possession, descriptive ablative, ablative of measure 
of difference, cam-causal clause, the subjunctive with 
priusquam, relative clause of purpose, substantive 
clause of result, independent volitive subjunctive, 
future active participle without sum. The last two of 
these constructions Mr. Byrne assigns to the fourth 
year, the others to the second. It may be added that 
he marks the hortatory use of the volitive subjunctive 
as wanting in the Caesar usually read, and the use of 
the future active participle outside of the periphrastic 
conjugation as wanting in both the Caesar and the 
Cicero. 

Several of the sentences are too difficult for first- 
year pupils, from the presence in them of unfamiliar 
words and constructions, or because of the incomplete- 
ness of the thought, or in that they present a hard 
problem in rendering. Four of the twenty of Test B 
are entirely unreasonable: 14, 15, 19, 20 (see above, 
page I55\ If any one doubts the disturbing effect of 
the conditions I have noted, let him compare the results 
in the case of sentences in which these conditions are 
present with those of more satisfactory sentences. 
Sentence 1 of Test A was translated correctly by a 
slightly larger proportion of first year pupils than of 
fourth year, while Sentence 3 was translated correctly 



by 95.2 per cent, of fourth year pupils, and only 53.9 
per cent, of first year. There is also a large superiority 
of the fourth year pupils over those in the second and 
the third years in the rendering of Sentence 3, but 
Sentence 1 is done better by third year pupils and 
exactly as well by second year. Now, puella occurs 
in all High School Latin only twice in Vergil, and 
canto is found only once, in Cicero; but puella is 
pretty generally used in beginning books, elementary 
readers, and composition exercises, while the meaning 
of canto can be got by the student of Vergil from cano, 
with which he is familiar. Such factors as this would 
not be taken into account by one who was not an 
experienced and acute teacher of Latin. They are 
operative in all tests set by Mr. Brown. I believe 
that educational measurements are largely vitiated 
through neglect of similar factors, and that an expert 
in the subject concerned should always collaborate in 
studies such as this. It is possible to fix the cause of 
the extraordinary variation in the handling of the two 
simple sentences I have mentioned; but no one can 
say whether the score on the later sentences of the 
test is affected by this or that specific difficulty or by 
general conditions, such as hurry or the lack of con- 
fidence that attends the discovery of one's inability 
to do the task set before him. 

Following the order in which Mr. Brown has pre- 
sented his material, we pass next to the Connected 
Latin Test. This contains 52 lines of text, in which 
there are 359 Latin words. An hour-examination in 
sight-translation for second year pupils would ordi- 
narily be less than half this length, but only fifteen 
minutes were allowed by Mr. Brown for the test. 
109 distinct essential ideas are expressed in the Latin, 
according to the Key used in scoring the results. 
It is doubtful whether any teacher could have written 
a fully satisfactory paper in the time allowed; and 
a boy or a girl could hardly be expected to paraphrase 
an English passage of the same length in this time. 
Furthermore, the pupils were told to "begin promptly 
to write the thought of the Latin in English". This 
was vicious. They should have been advised to read 
the entire passage through for its general sense, before 
beginning to write at all. The objection to the limita- 
tion of time cannot be dismissed on the ground that 
the scoring emphasizes the relation of the amount 
correct to the amount attempted. The pupil cannot 
be expected to understand connected narrative unless 
he reads consecutively, and the effect of an overlong 
test, presented as an entirety, is sure to be hasty 
jumping about in search of that which is easiest. 

Though the passage set on this test is, for the most 
part, simple and easy, there is one paragraph of four 
lines near the end which contains three words (nimius, 
fiducia, voluptas) that do not occur in the Caesar 
usually read in the Schools, and two words (luxuria. 
designo) that occur only once. It may be said that 
luxuria should be grasped from its English derivative, 
but this sort of association is not easily made in hasty 
work. In the passage in question, the meaning of 
nindam luxuriant et victoriae fiduciam dcsignarent 
would be so obscure to the pupil that the rest of the 
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sentence would not yield its meaning. This leaves 
but six words of the paragraph within the grasp of th e 
pupil 2 . 

Here again one wonders whether the investigator 
has the knowledge of Latin required for his task, or the 
experience in teaching a foreign language. For one 
thing, he seems to expect the pupil to hunt out, and 
translate, first the principal subject and its verb. 
So the Key gives for Sed. . . contulit, at the opening of 
the third paragraph of the passage, the following: 

But Pompey left the field of battle 

And he immediately retreated 

[He went] on horseback 

[He retreated] to .his camp 

[This was because he was] in despair 

[His despair was] concerning the rest 

[He did this] when he saw his cavalry routed 

[This happened] (and) when also he observed thrown 
into confusion that part 

[This was the part] in which he had especial con- 
fidence. 

Here we have not only an order utterly at variance 
with the correct method of approach, but a misrepre- 
sentation of the meaning of aliis dtffisus. The square 
brackets, it should be noted, are employed to secure a 
scoring of the text with reference to the proper con- 
nection of the thought; but the arrangement neglects 
the carrying on of the thought from sentence to sen- 
tence, and the real effect of the order of the presenta- 
tion of ideas within the sentence. That the arrange- 
ment is to be taken as indicating Mr. Brown's de- 
liberate intention is shown by his statement that the 
portions outside of the brackets "give a perfect literal 
translation". 

In summing up the results of the Connected Latin 
Test Mr. Brown draws this conclusion (54-55): 

. . . Four years of study have thus developed an average 
ability to write in English in fifteen minutes the thought 
of a little less than fifteen lines of Latin of the difficulty 
of that represented in this test, with about eight and 
a half lines correct. 

Does Mr. Brown realize that his test is, in part, one 
in English composition? Has he any notion how 
many lines the pupils would have written in English, 
and with what degree of accuracy, had they been 
asked to relate a series of simple actions performed 
before their eyes at the time? Of course, this sort of 
composition in English would be much more familiar 
and direct than any translation from Latin could 
possibly be. 

Another unfavorable conclusion is drawn from a 
comparison of the score of pupils in different vears of 
the Latin course: 

Fourth year pupils can get correct twenty-four per 
cent more of what they write than can second year 
pupils. This seems hardly adequate as a result of 
two years of intensive study of Latin. 

Again an important factor is disregarded. The 
failure to gain in power to render Caesar that is shown 
in the fourth year (not in the third) may be due prima- 
rily to the difference between Caesar and Vergil in 
vocabulary, style, and content. A course in Shake- 
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speare may be valuable, even if it does not lead to a 
great increase in power to read the daily paper in- 
telligently. 

The Latin Grammar Test is, on the whole, satis- 
factory. The sentences are short and easy, and they 
are translated. It is true that there are three of the 
twenty which ask for constructions not found in the 
Caesar read in the Schools (hortatory subjunctive, 
deliberative subjunctive, and direct contrary-to- 
fact condition), and two or three of the other con- 
structions are not treated in some of the books for 
beginners; but a test set for pupils in all four years of 
the course must go beyond the scope of the first year's 
work. 

There is nothing to show whether the time-allowance 
was an element in the failures on this test, but it is 
not probable that it was too short to allow opportunity 
for the simple response required. Some part of every 
class understood each construction. On the other 
hand, no pupil understood them all, and the average 
does not reach half the number of constructions in 
any year. Here Mr. Brown's strichires are not a 
whit too severe. Yet it may be questioned whether he 
is right in his conclusions. "Formal knowledge of 
construction, it will be remembered", he says, "is a 
thing which these schools make to a large degree the 
end and aim of Latin instruction, and it seems clear 
that . . . there must be waste in the process". My 
observation leads me to the belief that grammatical 
instruction does not hold the place in Latin teaching 
that it once did, and in New Hampshire, at the time 
when Mr. Brown was making his investigation, all 
formal study of grammar was in disfavor at the edu- 
cational headquarters of the State. The results of the 
Latin Grammar Test are certainly significant, but 
what is the significance? May it not be that grammar 
is not studied with sufficient thoroughness? And 
may not the failure to master fundamental linguistic 
principles account, in some measure, for the unsatis- 
factory showing on the tests in translation? 

The Latin Vocabulary Test is reasonable, though 
the words included are not equally frequent in the 
reading of the different years of the course. At least 
seven of the fifty are not found in Aeneid 1-6 (vallum, 
pilum, intellego, inopia, fossa, nolo, cotidie), and some 
others are not common. In the case of all the words 
mentioned above, the second year pupils made a 
better score than the first year, and the third year 
pupils made a better showing than the second year; 
but the percentage of fourth year pupils who knew 
these words was not so high as that of third year. 
It might be supposed that here lay the explanation 
of the lower average of the fourth year class, but that 
class is unaccountably inferior in its knowledge of 
other words. For instance, this is. the percentage of 
pupils in each year who gave the meaning of spes 
correctly: 78.5; 94.3; 100; 79.8. Now, spes occurs 
somewhat more times in the School Vergil than in the 
Cicero. Mr. Brown's comment on the results of this 
test is brief, since the results are favorable. He 
notes that the poor showing on the tests in trans- 
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lation "apparently is not due to lack of knowledge of 
easy Latin words". 

I turn now to the more important features of the 
pamphlet, the arguments in which the scores on the 
tests are employed to show present conditions and to 
indicate the need of change. 

Mr. Brown makes his study tend to the support of 
the so-called Translation Method of teaching Latin, 
which was, at the time of his investigation, strongly 
recommended to the Schools of New Hampshire by 
the State Department of Public Instruction. Now 
the Translation Method is based upon the theory that 
the language can be best learned by reading it from 
the first without the memorizing of inflections, the 
labeling of forms, or the description and classification 
of constructions. From my limited observation, I 
am inclined to believe that what the pupil really does, 
under this Method, is to guess at the meaning of the 
Latin. Indeed, that is all he can do, unless extensive 
reading under competent guidance has taught him 
the functional force of forms and constructions so 
thoroughly that he responds automatically to the many 
grammatical elements which enter into the expression 
of the thought of the original, as a Roman would. 
Mr. Brown's tests show that no such automatic re- 
sponse has been produced in any of the Schools of 
New Hampshire. I hold, as I have said, that forms 
and constructions can be learned profitably only as 
the knowledge is to be used, andean be fixed in memory 
economically only as far as the knowledge is used. 
I grant also that the language could be learned by the 
Translation Method, as by the Direct Method, if we 
had the time. Even then, however, we should have 
to ask ourselves whether we were not sacrificing real 
and attainable advantages for a kind of knowledge of 
Latin which would have little value in American 
education. Only a small proportion of those who 
begin the study of Latin in our Schools continue the 
study long enough to gain command of the language 
by any method. For the others, reading is the vehicle 
of instruction in linguistic laws of general application, 
and it must be ratiocinative reading. 

Particular Schools were chosen by Mr. Brown for 
the comparison of methods. Doubtless it was con- 
venient, for the purpose of certain tables, to have the 
same number of Schools in each group; but it is 
advisable, in such an investigation, to compare all 
your facts, or to explain the ground of selection more 
definitely than Mr. Brown does. School 34 had a 
higher score in the Grammar Test, for all four years, 
than the average of all pupils in any of the groups 
chosen for the comparison of the value of methods; 
School 33 had a higher score for three years ; School 1 1 
for two years. School 8 had no score for the first 
year, but equaled the score of the highest group (Gram- 
matical Method) in the fourth, and excelled all the 
groups in the other two years. These four Schools 
are not included in the reckoning. By an oversight, 
the test was not given in School 14 to the fourth year 
pupils, but it is chosen as one of the eight which form 
the Grammatical Method group. It has the lowest 
score of any School in the second and third years, 



and one of the lowest in the first year. Presumably 
Schools 34, 33, 11, and 8 use the Grammatical Method, 
but Mr. Brown's statement is not clear. He says 
that a third of the Schools teach the Grammatical 
Method, eight the Translation Method or a close 
approach to it, and the remaining eight a modification 
of one method in the direction of the other. This 
division fits the latter classification of selected Schools 
for the comparison of method, rather than the total 
number tested (34). 

Mr. Brown tells us that the Schools which employ 
the Grammatical Method have a comparatively 
large allotment of time for Latin, but they had no 
advantage in the Grammar Test over those which 
employ the Translation Method. Although they had 
a higher score for the first and fourth years, they fell 
behind in the othc- two. Mr. Brown believes that he 
has clearly shown that the knowledge of constructions 
does not lead to understanding of the language, but 
his tables scarcely justify his confidence. In the 
examination of this question, the Schools are arranged 
in four groups, in the order of their efficiency in the 
Connected Latin Test. Group IV stood much higher 
in all the three classes to which the test was given. 
It was also higher, in all three classes, in the Grammar 
Test. Mr. Brown makes much of the slightness of the 
excellence in grammar, but the test was slighter, and 
the range of the score was slighter. The variation 
in the amount correct on the Connected Latin Test 
is from 13.54 to 65.25, and in comprehension from 22 
t° 73. while in the Grammar Test the lowest score was 
1.20, and the highest only 2.84. In the second year, 
Group I had 22 in comprehension and 1 .20 in grammar, 
while Group IV had 58 in comprehension and 2.15 in 
grammar. In the fourth year, the scores are 44 and 
1.93 for Group I, 73 and 2.84 for Group IV. If he 
had been so disposed, Mr. Brown might have argued 
from these figures that a little firmer hold on grammar 
leads generally to a much clearer understanding of the 
language. Perhaps, however, the only safe inference 
is that the better Schools will show better results in both 
kinds of tests. (To be concluded) 
The Phillips Exeter Academy JOHN C. KlRTLAND 



CLASSICAL CLUB OF GREATER BOSTON 

A joint meeting of the Classical Club of Greater 
Boston and the Eastern Massachusetts Section of The 
Classical Association of New England was held at 
Harvard University, on February 11, with the following 
program: A Word of Welcome, Mr. F. A. Tupper, 
Head Master of the Brighton High School, President 
of the Section; Futuristic Farming, Miss Eva M. 
Sanford, Radcliffe College; The Three Electras, Dr. 
F. B. Lund, Boston; Lantern Talk, Greece of Yes- 
terday and To-day, Miss Emma G. Cummings, 
Brimmer School, Boston; Lantern Talk, Two Recent 
Acquisitions: A Gold Libation Bowl from Olympia 
and an Athenian Terra Cotta from Egypt, Dr. L. D. 
Caskey, Boston Museum of Fine Arts. 

Since the beginning of the new year two meetings 
of the Reading Section of the Classical Club have 
been held in the Classical Library of Boston Uni- 
versity. At the first Dr. Lund gave his translation of 
the Antigone; at the second, Professors Rice and 
Cameron, of Boston University, translated the Phormio. 
Albert S. Perkins, Censor. 



